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16.  Abstract 

To  evaluate  the  Ocuiometer  as  a visual  fixation  measuring  device  for  man/machine 
interface  investigations,  six  air  traffic  controllers  performed  simulated  radar 
control  functions.  A seventh  controller  performed  the  control  tasks,  while  both 
an  Ocuiometer  record  and  a manual  record  were  made  of  visual  attention.  It  was 
found  that  all  the  controllers  spent  approximately  80  percent  of  the  test  time 
looking  at  the  radar  display,  with  a mean  of  76  glances  at  the  display  per 
15-minute  session.  Average  glance  duration  was  10  seconds.  Approximately 
11  percent  of  the  remaining  time  was  spent  looking  at  the  flight  progress  strips, 
less  than  5 percent  looking  at  the  computer  input  keyboard,  and  less  than  3 percent 
looking  at  miscellaneous  or  indeterminate  objects.  No  marked  differences  appeared 
in  the  scores  of  individual  controllers  although  they  had  been  selected  to 
represent  a diversity  of  air  traffic  control  experience.  In  the  comparison  of 
methods  of  recording  visual  performance,  good  agreement  was  obtained  between  the 
Ocuiometer  and  manual  kymograph  recorder  on  time  spent  looking  at  the  radar,  flight 
strips,  and  keyboard.  The  Ocuiometer  was  capable  of  recording  brief  eye  movpients 
and  additional  detail  which  was  difficult  if  not  impossible  with  the  manual  obser- 
vation method.  This  additional  precision  of  recording  was  accompanied,  however,  by 
an  additional  workload  in  data  reduction.  It  was  concluded  that  the  Ocuiometer 
has  the  potential  to  produce  reliable  and  accurate  information  when  used  within  the 
limits  of  its  design.  The  addition  of  automatic  output  of  coordinates  of  fixation 
would  be  a valuable  improvement  resulting  in  reduced  test  workload. 
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INTRODUCTION 


PURPOSE. 

The  purpose  of  this  evaluation  was  to  determine  the  utility  of  the  Oculometer 
as  a tool  for  the  study  of  visual  performance  in  a radar  control  situation. 

BACKGROUND. 

In  tests  of  display  and  data  entry  equipment,  it  is  often  necessary  to  measure 
and  record  what  the  human  operator  is  looking  at.  In  the  analysis  of  air 
traffic  control  (ATC)  systems,  the  ccmmonly  used  method  of  activity  recording 
consists  of  stationing  an  observer  nex*  to  the  subject  controller  and  equipping 
this  observer  with  a device  that  moves  graduated  graph  paper  across  an  aperture 
at  a constant  speed.  Called  the  method  of  kymograph  recording,  or  the  manual 
recording  method,  this  technique  depends  on  the  observer's  judgment  of  the 
direction  of  the  subject's  attention  for  the  decision  of  what  the  controller 
is  looking  at.  Principal  clues  to  the  direction  of  attention  are  the  movements 
of  the  subject  controller  observed,  particularly  hand  and  head  movements,  and 
the  direction  of  the  controller’s  gaze,  insofar  as  it  can  be  noted  by  watching 
him  move,  turn  toward,  and  reach  for  things. 

In  some  special  situations,  the  most  important  activities  for  recording  are 
shifts  of  visual  attention.  This  is  the  case  when  scanning  patterns  are 
investigated  or  when  time-sharing  performance  is  important  in  a task  heavily 
loaded  in  the  visual  channel.  With  pilots,  for  example,  a special  type  of 
kymograph  has  been  used  to  determine  how  much  time  is  spent  looking  at  the 
cockpit  instruments  versus  how  much  time  is  spent  in  outside  search  for 
possible  collision  threats.  This  recording  device  produces  a recorded  auditory 
tone  when  a button  is  pressed  and  held  down.  Different  frequencies  are  recorded 
for  each  area  of  attention.  But  the  procedure  is  essentially  the  same  as  that 
for  ATC  systems,  since  the  sound  recorder  is  activated  by  an  observer  who 
watches  the  subject  and  codes  the  observed  behavior  into  categories  as  it  is 
observed  in  real  time. 

Motion  picture  and  video  recordings  have  been  used  in  time  and  motion  study 
of  highly  repetitive  operations  in  industry.  This  method  is  costly  and  is 
less  useful  in  the  study  of  human  data  processing  and  decision  making  because 
much  is  not  detected  by  a stationary  camera.  In  light  of  this,  the  Oculometer 
was  developed  to  improve  the  measurement  and  recording  of  visual  performance, 
with  particular  application  to  the  problem  of  aircraft-pilot  visual  time  sharing. 
A precise  and  automated  system  was  needed  because  of  the  difficulty  of  squeezing 
an  observer  into  cockpit  position  to  view  pilot  eye  movements  and  because  of 
the  need  to  determine  exactly  where  the  pilot  was  looking  in  response  to 
warning  information  conveyed  by  a variety  of  displays. 

Since  it  is  a helmet-mounted  camera,  the  Oculometer  moves  with  head  movements 
to  record  the  scene  before  the  subject.  A focus  index  produced  by  projecting 
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a signal  into  and  back  out  of  the  eye  shows  the  spot  in  the  scene  that  is 
being  viewed  by  the  subject  at  a given  instant.  With  the  additional  feature 
of  a video  tape  recording  of  the  combined  forward  scene  and  focus  index,  it 
becomes  possible  to  record  the  precise  line  of  sight  and  play  back  the  recorded 
information  as  many  times  as  necessary  and  as  slowly  as  necessary  to  make 
accurate  judgments  as  to  the  focus  of  visual  attention.  For  example,  when 
the  hands  are  being  used  to  depress  keys  to  put  information  into  a data 
processing  system,  the  eyes  will  move  to  the  same  spot  as  the  hands.  The 
visual  scene  that  the  Oculometer  plays  back  will  show,  then,  the  fingers 
moving  to  and  pressing  the  keys  at  the  same  time  that  the  focus  index  swings 
to  the  same  keys.  Watching  the  playback  of  both  the  hand  action  and  the 
shift  of  visual  attention,  the  observer  obtains  considerable  assurance  that 
an  intentional  action  took  place,  and  he  has  the  means  at  hand  to  determine 
the  time  duration  of  the  action. 

The  features  of  the  Cculometer  as  described  above  made  it  appear  that  the 
system  might  find  a useful  application  in  the  study  of  ATC  displays  and 
procedures.  Like  the  pilot  for  whom  the  Oculometer  was  originally  developed, 
the  controller  is  heavily  loaded  in  the  visual  channel.  Often  he  is  seated 
before  a radar  display  that  shows  map,  route,  and  weather  information,  the 
positions  of  several  aircraft  under  control,  and  alphanumeric  data  blocks 
attached  to  the  tracked  aircraft.  The  positions  of  the  aircraft  are  moving, 
and  important  changes  are  appearing  in  the  data  blocks.  Hence,  the  radar 
display  must  be  watched  closely.  At  the  same  time,  the  controller  is  required 
to  refer  to  posted  information  and  particularly  to  data  that  is  tabulated 
on  fli»  ht  progress  strips  in  columnar  bays  alongside  the  radar  display. 

A third  category  of  requirement  for  the  visual  attention  of  the  controller 
in  a typical  radar  control  situation  is  the  data  input  keyboards  and  associated 
controls.  In  many  instances,  when  the  controller  notes  significant  informa- 
tion or  decides  on  a new  control  action,  he  must  not  only  verbalize  the 
decision  to  an  associate  or  a pilot  of  a controlled  aircraft,  but  he  must  also 
press  a series  of  keys  to  put  the  information  into  the  computer  system. 
Important  changes  such  as  a new  altitude  or  speed  must  be  written  on  the  flight 
progress  strip  which  bears  data  on  the  particular  flight.  This  also  requires 
the  controller  to  look  away  from  his  primary  display. 

Manual  recording  with  a hand-held  kymograph  can  be  used  to  evaluate  the  effect 
on  visual  performance  of  a change  in  display  equipment  or  procedures,  but  the 
potential  advantages  of  the  Oculometer  for  the  purpose  are  apparent.  Since 
primary  attention  is  on  the  radar  display,  many  glances  to  the  strips  or  data 
entry  keyboards  will  be  very  brief.  This  makes  it  easy  to  miss  some  of  them 
when  using  the  manual  method  in  real  time.  In  addition,  when  the  test  involves 
a change  in  display  format  or  the  utilization  of  a particular  item  of  informa- 
tion such  as  a particular  flight  progress  strip,  a higher  degree  of  precision 
than  can  be  obtained  manually  may  be  required.  The  only  way  to  tell  whether 
the  controller  is  looking  at  a particular  item  is  to  have  a precise  recording 
system.  The  Oculometer  appears  to  be  an  approach  in  that  direction. 
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After  the  original  model  of  the  Oculometer  was  delivered  to  the  Federal  Aviation 
Administration  (FAA)  by  the  design  contractor,  the  system  was  redesigned  by 
the  National  Aviation  Facilities  Experimental  Center’s  (NAFEC’s)  engineering 
staff  to  reduce  the  weight  of  the  helmet  and  improve  overall  system  reliability. 
When  these  efforts  were  successfully  completed,  the  system  was  assigned  to  the 
Human  Engineering  Branch  at  NAFEC  for  evaluation. 


DISCUSSION 


THE  SIMULATED  AIR  TRAFFIC  WORK  SITUATION. 

To  measure  the  visual  performance  of  controllers  and  compare  the  measures 
obtained  by  the  manual  recording  method,  it  was  necessary  to  create  a controlled 
work  situation.  The  presence  in  the  controller-computer  interface  laboratory 
of  a console  roughly  similar  to  an  enroute  plan  view  display  and  the  availabil- 
ity of  a recorded  air  traffic  scenario  made  it  feasible  to  make  up  a partial 
simulation  of  an  enroute  sector  position.  A flight-strip  mounting  board  was 
attached  to  the  right  of  the  display,  similar  to  a strip  board  in  the  current 
enroute  sector.  This  approximation  of  the  radar  control  position  is  illustrated 
in  figure  1.  The  general  experimental  question  was:  "What  is  the  division  of 

visual  attention  between  the  radar  display.,  the  data  entry  devices  (keyboard 
and  slew  ball),  the  flight  progress  strips,  and  miscellaneous  areas  during 
the  period  the  controller  was  evaluating  the  traffic  situation  presented  to 
him,  resolving  the  conflicts  which  would  occur,  and  marking  the  strips  to 
show  his  decisions?"  Since  the  recorded  radar  display  problems  were  avail- 
able in  three  different  versions,  three  different  sessions  were  completed  by 
each  controller  subject. 

TEST  PROCEDURES. 

Three  15-minute  radar  problems  were  presented  to  each  of  six  subjects.  The 
radar  display  depicted  a relatively  simple  ATC  routing  pattern  over  which  a 
moderate  level  of  simulated  operational  air  traffic  was  portrayed.  In  a few 
cases,  conflicts  involving  the  violation  of  normal  separation  standards  were 
included.  This  display  was  considered  to  constitute  a partial  replica  of  the 
situation  display  usually  found  in  enroute  air  traffic  centers  and  to  have 
enough  traffic  movement  to  require  a normal  amount  of  controller  attention. 

In  addition  to  monitoring  the  radar  display,  the  controller  subject  was  asked 
to  do  the  following  two  things:  First,  he  was  to  update  the  flight  information 

marked  on  the  flight  progress  strips;  second,  he  was  asked  to  make  simulated 
handoffs  to  adjacent  sectors  and  acknowledge  handoffs  from  other  sectors,  using 
the  keyboard  and  slew  ball.  These  input  devices  were,  however,  deactivated, 
so  that  there  was  no  feedback  from  such  simulated  handoffs.  When  a potential 
conflict  was  detected,  the  subject  was  asked  to  determine  what  control  action 
would  best  resolve  it  and  to  speak  the  control  instruction  and  update  the 
strip  involved  to  show  the  action  taken. 
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The  test  design  called  for  two  groups  of  three  subjects  each,  with  each  man 
wearing  the  Oculometer  helmet  in  three  successive  test  sessions.  Hence,  in 
the  basic  series  there  were  eighteen,  15-minute  tests  with  the  Oculometer. 

The  first  controller  group,  subjects  numbered  1 through  3,  were  men  experienced 
primarily  in  terminal  air  traffic  facilities.  The  second  group,  subjects  4 
through  6,  were  former  enroute  controllers.  All  subjects  had  normal  uncorrected 
vision.  This  was  a necessary  selection  standard  because  the  Oculometer  is  not 
designed  to  track  visual  fixations  of  a person  wearing  eye  glasses  or  contact 
lenses.  Subjects  2 and  6 were  found  to  be  left-eye  dominant. 

In  pretests,  it  was  found  that  certain  sweeping  eye  movements  without  corre- 
sponding head  movement  resulted  in  loss  of  tracking.  Hence,  the  visor  was 
reframed  by  adding  tape  to  reduce  the  field  of  vision.  The  subject  then  was 
looking  out  through  a 6 3/4-inch-wide  by  2 1/4-inch-high  aperture. 

The  rectangular  aperture  was  so  placed  before  the  subject's  eyes  that  he  was, 
in  reality,  looking  through  a 1 1/2- inch  by  6 3/4-inct.  window,  the  plexiglass 
being  slanted  at  an  angle  of  40°  to  the  vertical.  The  center  of  the  slanted 
helmet  window  was  2 1/2  inches  in  front  of  the  eyes  of  the  average  subject. 

This  geometry  enabled  the  helmet  optical  system  to  reflect  the  infrared  light 
from  its  generator  to  various  mirror  planes  and  to  the  eyeball  and  return. 

It  was  calculated  that  the  horizontal  field  of  vision  was  40°  to  either  side 
of  the  line  of  sight  of  the  subject  (total  * 80°) „ The  vertical  field  was 
about  plus  14°  and  minus  20®  (total  ■ 34°) . This  total  field  of  view  was 
about  50  percent  greater  than  the  effective  tracking  field,  but  sufficed  to 
enforce  head  movement  in  the  subject  so  that  tracking  was  rarely  lost. 

The  outputs  of  the  Oculometer  were  recorded  on  video  tape  for  later  analysis. 
This  analysis  was  carried  out  by  having  an  expei.'imenter  watch  the  playback  of 
the  taped  scene  and  translate  the  eye  fixations  to  chart  paper  on  a hand-held 
kymograph  similar  to  the  type  ordinarily  used  in  manual  recording  of  visual 
performance  (figure  2).  In  this  rerecording,  all  fixations  were  categorized 
into  five  areas,  the  radar  (R)  (cathode-ray  tube  display),  the  flight  progress 
strips  (S),  the  keyboard  and  slew  ball  (data  entry  devices(K)),  a miscellaneous 
category  that  included  such  things  as  looking  at  the  watch,  cigarette,  or  other 
irrelevant  object  (M) , and  a lost-data  category  called  undetermined  (U) . If 
the  clues  present  on  playback  of  the  video  recording  were  insufficient  to 
determine  the  particular  fixation,  or  if  the  fixation  seemed  to  be  halfway 
between  main  classifications,  the  time  of  the  fixation  was  allocated  to 
undetermined. 

To  insure  that  the  experimenter  viewing  the  video  playback  did  not  miss  any 
glances,  two  people  were  employed  in  the  rerecording.  One  watched  the  play- 
back continuously  and  called  out  the  appropriate  category  to  an  assistant  who 
marked  the  chart  paper.  It  appeared  that  the  reaction-time  delays  in  mark- 
ing the  start  of  a glance  were  equivalent  to  the  delays  in  marking  the  end 
of  a glance,  so  that  this  two-man  method  did  not  introduce  a large  measure- 
ment error. 


Following  Che  main  test  series  of  18  sessions,  one  15-«inute  radar  problem 
was  given  Co  a sevench  subjecC  wich  boch  Che  OculomeCer  recording  iCs  video 
cape  and  an  observer  making  a manual  recording  bn  Che  kymograph.  Afcer  Che 
Cesc  session,  Che  video  cape  was  rerecorded  on  chare  paper  as  in  Che  earlier 
18  cases,  providing  Cwo  kymograph  recordings  for  comparison  of  Che  alcernace 
mechods  of  recording  visual  performance. 

VISUAL  ATTENTION  RESULTS  AS  MEASURED  BY  TOE  OCULOMETER  ♦ 

In  Cables  1 and  2,  Che  visual  performances  of  Che  subjeecs  in  Che  firsC  and 
second  concroller  groups  are  summarized.  The  five  caCegories  of  fixaCion,  R 
for  radar,  S for  scrips,  K for  keyboard  - slew  ball,  M for  miscellaneous,  and 
U for  undecermined,  are  arranged  vercically,  while  Che  firsC,  second,  and 
Chird  problems  for  each  of  Che  chree  subjecCs  in  each  group  are  arranged 
across  Che  Cop  of  Che  cables.  The  CoCal  Cine  spenc  looking  aC  Che  five  caCe- 
gories, Che  percencage  conversion  of  ChaC  CoCal  time,  Che  number  of  individual 
glances  concribucing  to  Che  tocal  time  in  category,  and  Che  average  duration 
of  glance  for  each  category  are  shown.  Inspection  of  che  Cables  will  show 
Chat  Che  results  were  roughly  comparable  for  boch  groups  of  controllers.  All 
six  subjects  spent  Che  vast  majority  of  Che  problem  time  looking  at  Che  radar. 
This  was  to  be  expected  from  Che  nature  of  the  task,  and  the  results  suggest 
Chat  che  simulated  work  situation  was  successful,  at  least  Co  a degree,  in 
simulating  an  actual  control  situation.  Field  surveys  have  shown  Che  same 
result,  that  the  radar  controller  spends  the  bulk  of  his  time  monitoring  the 
cathode-ray  tube  display.  Radar  controllers  find  the  usual  work  situation 
made  more  difficult  by  a requirement  to  look  away  from  the  radar  for  other 
parts  of  the  control  task. 

In  descending  order  following  the  radar  category,  the  subjects  spent  the  most 
time  looking  at  the  strips,  then  the  input  devices.  Miscellaneous  areas  of 
fixation  accounted  for,  at  most,  2 percent  of  the  controllers  time,  while 
the  undetermined  category  was  less  than  1 percent  for  all  but  subject  6. 
Inspection  of  the  tables  reveals  also  that  the  performances  did  not  vary  widely 
between  the  first,  second,  and  third  radar  problems.  Thus,  the  fixation  cate- 
gory data  from  the  main  series  of  18  test  sessions  gave  the  appearance  of  a 
High:  degree  of  regularity  across  problem  replications  and  across  different 
subjects.  This  finding  may  suggest  that  the  recording  and  transcribing 
procedures  were  fairly  reliable  and  that  the  subjects  performed  the  assigned 
tasks  with  a degree  of  consistency.  Before  making  that  decision,  however,  it 
is  necessary  to  consider  the  subjective  impressions  of  the  experimenters.  On 
the  question  of  the  definiteness  and  certainty  of  the  recorded  data,  could 
the  experimenters  judge  whether  or  not  the  playback  of  the  video  tapes  showed 
the  subject  to  be  scanning  the  radar  in  a way  that  would  enable  him  to  perceive 
the  data  blocks,  and  whether  or  not  he  shifted  his  eyes  from  the  data  block 
on  a particular  track  to  the  flight  strip  for  that  same  track,  as  would  be 
expected  considering  the  task  assigned.  There  is  no  numerical  data  available 
on  this  point,  but  it  is  believed  that  the  impressions  of  the  three  experi- 
menters who  observed  all  the  video  playbacks  were  quite  definite  that  the 
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visual  fixations  as  revealed  in  the  playback  were  consistent  with  the  logical 
sequence  of  the  task  demand's.  Also,  it  appeared  that  the  particular  data 
block  fixated  and  the  particular  strip  could  generally  be  Identified  in  the 
video  recording.  Hence,  the  experimenters  believed* that  there  was  little 
chance  that  time  recorded  a3  radar  was  erroneously  interpreted  and  was 
actually  spent  looking  at  another  area.  The  subjective  Impressions  of  the 
experimenters  were  that  the  data  in  the  tables  were  accurate  as  interpreted 
from  the  video  playback. 

Table  3 presents  the  visual  attention  data  with  all  six  subjects  pooled. 

Out  of  the  900  seconds  of  problem  time  per  session  (15  minutes),  the  controllers 
spent  726  seconds  looking  at  the  radar  display.  This  accounts  for  about 
81  percent  of  their  time.  Strips  were  fixated  for  about  103  seconds,  nearly 

11  percent  of  the  time,  input  devices,  44  seconds,  which  is  less  than 

5 percent  of  the  time,  and  miscellaneous  and  undetermined  together  made 
up  the  remaining  3 percent  of  the  total  time.  Radar  glances  were  the  most 
frequent,  but  by  an  even  larger  margin,  they  were  longer  in  duration.  Keyboard 
glances  averaged  less  than  2 seconds  each,  a figure  that  is  realistic  only 
for  a procedure  that  emphasized  use  of  the  slew  ball  and  keyboard  entry  of 
only  single-key  and  very  brief  input  messages. 

When  using  the  slew  ball,  it  is  normal  to  fix  one's  gaze  on  the  radar  display. 

The  eyes  may  be  averted  to  the  slew  ball  itself  for  only  an  instant  as  the 
hand  moves  to  the  ball  or  as  the  ENTER  button  next  to  the  ball  is  depressed. 
Similarly,  a simulated  handoff  requires  only  one  to  four  keys  to  be  touched. 

To  accept  a handoff,  the  subject  was  instructed  to  uce  the  slew  ball  and  ENTER 
button  or  to  go  to  the  keyboard  and  insert  the  aircraft  identity  and  hit  the 
ENTER  button.  To  give  a handoff,  the  controller  used  tne  keyboard  to  select  a 
sector,  an  aircraft  identification,  and  the  ENTER  button,  or  he  used  the  slew 
ball  to  select  an  aircraft,  the  keyboard  to  note  a sector  identification,  and 
hit  the  ENTER  button.  In  the  real  enroute  situation,  it  may  be  noted  that  the 
radar  controller  sometimes  enters  more  complicated  and  lengthy  keyboard  messages. 
Hence,  it  is  probable  that  the  present  work  situation  distorts  the  results  in 
the  direction  of  short  glances  at  input  devices. 

Since  the  experimenter  observing  the  playback  of  the  vide  it  tape  made  by  the 
Oculometer  could  identify  even  the  particular  item  fixated  within  a category, 
such  as  the  radar  or  strips,  the  Oculometer  data  would  appear  to  add  something 
of  possible  value  to  the  kina  of  data  usually  obtained  with  manual  recording 
techniques.  Simply  watching  where  the  controller  is  looking  does  not  allow 
detection  of  the  specific  item  fixated,  and  it  does  not  allow  detection  of 
the  scanning  pattern  in  running  over  a small  area. 

As  noted  previously,  subject  6 was  one  of  two  with  left-eye  dominance.  This 
subject  also  differed  from  the  average  of  the  others  in  producing  a relatively 
large  proportion  of  undetermined  time.  The  mean  for  his  three  problems  was 

12  percent  of  the  total  time  indeterminate.  A careful  replay  of  the  video 
tapes  produced  by  the  Oculometer  with  this  subject  showed  that  in  many  instances 
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TABLE  3.  VISUAL  ATTENTION  FOR  ALL  SIX  CONTROLLER  SUBJECTS  POOLED 
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when  the  task  would  require  him  to  look  at  the  strips,  and  In  fact,  his  gaze 
left  the  radar  and  shifted  in  the  direction  of  the  strips,  the  television 
camera  recorded  a focus  index  between  the  radar  and  the  strip  bay.  Subsequent 
checks  showed  that  the  helmet  had  been  aligned  properly.  Still  it  was  shown 
that  the  recorded  focus  index  was  often  as  much  as  6 inches  to  the  side  of  the 
target  the  subject  reported  himself  to  be  scrutinizing.  Movement;  of  the  indi- 
cated fixation  point  was  considered  abnormal  for  this  subject  during  some  of 
the  radar  category  time  as  well.  Particularly,  the  tracking  indicator  showed 
reduced  movement  equivalent  to  a "staring"  mode.  This  appears  to  be  a situa- 
tion that  is  influenced  by  the  contraction  of  the  pupillary  diameter.  A 
subject  with  a high  degree  of  light  sensitivity  and  a tendency  to  contract 
the  pupil  to  an  unusually  small  diameter  can  so  restrict  the  path  of  the 
infrared  beam  entering  and  exiting  the  eye  that  tracking  sensitivity  is 
reduced  and  it  appears  that  the  eye  is  moving  less  than  expected  by  the 
subject's  report. 

COMPARISON  WITH  RESULTS  OBTAINED  BY  THE  MANUAL  METHOD. 

One  15-minute  radar  problem  conducted  with  a seventh  controller  produced  dual 
paper  records  of  visual  performance,  one  from  the  kymograph  used  in  manual 
recording  of  eye  positions,  and  the  other  from  observation  of  the  video  tape 
playback  from  Oculometer  recording.  The  point  of  interest  was  the  differences 
in  the  results  as  derived  from  the  two  methods.  Table  4 summarizes  the  data. 

It  may  be  seen  that  there  was  one  consistent  difference  between  the  outcomes 
of  the  two  methods.  For  the  three  main  fixation  points  of  the  radar  console, 
i.e.,  the  radar,  strips,  and  input  devices,  the  Oculometer  recording  yielded 
a higher  number  of  glances  than  did  the  manual  method.  The  total  times  and 
percentages  of  fixation  time  for  the  three,  areas  were  roughly  similar  for  the 
two  methods,  with  the  major  difference  being  that  the  strip  category  was  scored 
higher  by  the  Oculometer  method.  As  can  be  seen  by  referring  to  the  data  on 
mean  duration  of  glances,  the  strip  glances  were  shorter  than  the  radar  glances 
by  a large  factor.  Hence,  it  appears  that  the  Oculometer  recorded  additional, 
very  brief  glances  at  the  strips  that  were  missed  in  the  manual  recording 
method.  The  experimenters  were  able  to  demonstrate  to  themselves  that  it  is 
possible  to  glance  toward  the  strips,  fixate  a particular  strip,  and  perceive 
a needed  datum  such  as  an  altitude  in  a total  elapsed  time  in  the  vicinity  of 
1 second.  Probably,  it  was  a glance  of  this  sort  that  was  missed  by  the  manual 
recording.  The  limited  data,  then,  seem  to  indicate  that  the  Oculometer  record- 
ing method  produces  a picture  of  visual  performance  very  similar  to  that  given 
by  the  manual  method,  with  the  major  difference  being  a capability  to  record 
brief  glances,  and,  as  indicated  before,  allowing  precise  determination  of 
the  particular  item  fixated,  as  contrasted  to  obtaining  only  the  general  area 
of  fixation  as  is  presently  possible  with  the  manual  method. 


TABLE  4.  COMPARISON  OF  VISUAL  ATTENTION  RESULTS  OBTAINED  WITH  THE  OCULOMETER 
AND  WITH  THE  MANUAL  METHOD 
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SHORTCOMINGS  OF  THE  OCULOMETER  SYSTEM. 

A more  complete  picture  of  the  complexity  of  the  system  may  be  obtained  by 
examining  figure  3.  The  subassemblies  cabled  together  with  the  main  electronics 
panel,  -video  playback  monitor,  power  supply,  and  control  boxes  mounted  on  an 
equipment  cart  are  illustrated  by  this  figure.  The  length  of  cable  limits  the 
television  camera  to  a range  of  movement  of  4 feet,  and  this  length  cannot  be 
changed  without  changing  data  processing  in  the  electronics  panel.  Parallax 
problems  prevent  an  accurate  picture  if  the  subject  moves  his  head  closer  than 
18  inches  to  the  object  being  inspected. 

Two  views  of  the  helmet  and  visor  are  shown  in  figure  4.  In  the  first  of 
these  helmet  views,  looking  down  at  the  top,  the  vidicon  camera  and  lens  assembly 
is  on  the  left,  while  the  infrared  light  source  and  folded  optics  are  to  the 
right.  In  figure  4,  the  masking  with  tape  of  the  lower  part  of  the  plastic 
visor  to  enforce  head  movement  when  looking  sharply  down  was  necessary  to 
preserve  optical  tracking  when  some  glances  downward  to  the  keyboard  and  slew 
ball  were  made.  The  present  design  permits  blockout  of  the  tracking  by  a 
lowered  eyelid.  This  may  be  capable  of  change  in  future  versions  of  the 
Oculometer. 

Calibration  is  required  for  each  individual  subject,  but  this  is  a relatively 
simple  and  fast  task.  From  the  experience  with  subject  6 in  the  main  problem 
series,  it  would  appear  that  in  addition  to  the  elimination  of  potential  sub- 
jects because  they  wear  glasses  or  contact  lenses,  an  occasional  candidate 
should  be  dropped  because  of  left-eye  dominance  or  because  his  tightly  contracted 
pupil  prevents  accurate  tracking. 

The  calibration  controls  are  shown  in  figure  5 alongside  the  playback  monitor 
and  oscilloscope.  The  television  picture  shows  that  the  subject's  head  is 
turned  toward  the  flight  progress  strips,  and  the  focus  dot  superimposed  on 
the  scene  shows  that  he  is  actually  looking  at  the  fifth  strip  from  the  top. 

The  circular  pattern  on  the  oscilloscope  indicates  the  dilation  of  the  subject's 
pupil  and  confirms  that  the  system  is  tracking. 

Some  idea  of  the  accuracy  of  the  Oculometer  system  may  be  obtained  from 
figure  6.  This  scene  shows  a subject  performing  in  a data  run.  He  is  entering 
an  altitude  on  a strip,  and  on  the  television  monitor,  the  focus  index  was 
actually  on  the  altitude  mark. 

To  determine  the  reaction  of  the  subjects  to  the  experience  of  wearing  the 
Oculometer  helmet  in  the  simulated  ATC  work  situation,  subjects  were  askek  to 
complete  a short  questionnaire  following  completion  of  their  three  test  sessions. 
This  form  appears  in  the  appendix.  A series  of  questions  asked  about  the  comfort 
of  wearing  the  helmet,  the  effect  of  the  red  dot  in  the  field  of  vision,  and 
the  effect  of  the  restriction  in  the  field  of  vision.  The  results  of  the  first 
question  indicated  that  the  subjects  found  the  headset  marginally  acceptable. 

Two  stated  that  it  was  not  comfortable.  They  did,  however,  complete  the  task 
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FIGURE  5.  OCULOMETER  CONTROL  PANEL  WITH  OSCILLOSCOPE  AND  MONITOR 


without  apparent  distraction  or  complaint.  Two  others  said  the  helmet  was 
acceptable  for  short  periods  of  wear,  such  as  the  15-minute  sessions  employed 
in  this  test.  The  fiscal  two  subjects  were  unwilling  to  call  the  headset  either 
comfortable  or  unacceptable,  but  rated  it  fair  in* comfort.  Five  of  the  six  said 
they  were  not  bothered  by  the  red  dot  projected  to  the  eye.  The  sixth  said  he 
was  bothered  at  times.  Four  of  the  six  reported  the  restricted  field  of  vision 
was  bothersome,  and  comments  were  appended  pointing  to  a feeling  of  uneasy 
movement  and  wooden  and  mechanical  movements.  Two  others  did  not  object  to 
the  restricted  field. 

The  weight  and  cumbersomeness  of  the  headset,  plus  the  discomfort  produced  when 
the  visor  pressed  against  the  nose,  made  the  subjects  conscious  of  the  apparatus. 
This  undoubtedly  is  a distraction  and  is  undesirable,  although  highly  motivated 
professionals  can  surmount  such  difficulties.  Four  of  the  subjects  stated, 
for  example,  that  they  could  have  worked  for  a longer  period  wearing  the  head- 
set. One  estimated  that  he  could  have  worn  the  headset  for  2 hours  without 
difficulty.  No  subject  believed  that  a single  15~mlnute  session  was  too  long 
to  wear  the  headset. 

SUGGESTIONS  FOR  IMPROVEMENT  OF  THE  OCULOMETER. 


The  discomfort  of  the  heavy  helmet  and  the  tendency  of  the  visor  to  press  on 
the  subject's  nose  has  already  been  mentioned.  Further  reduction  in  the  present 
4-pound  weight  of  the  helmet  assembly  would  be  highly  desirable.  Perhaps  more 
significant  is  the  matter  of  automating  the  transcribing  of  Oculometer  outputs. 

At  present,  the  output  is  a video  tape  that  must  be  inspected  by  an  observer  for 
coding  of  fixations.  It  seems  likely  that  a multichannel  recorder  could  be 
used  to  record  voltage  outputs  from  Oculometer  circuits  such  that  the  coordinates 
of  the  focus  index  would  be  available  for  further  examination.  If  the  limits 
of  each  attention  category  could  be  defined  in  related  coordinates,  the  class- 
ification into  radar,  strip,  and  keyboard  categories  might  be  performed  by 
machine.  This  would  reduce  the  amount  of  hand  labor  and  might  also  increase 
precision. 


CONCLUSIONS 


Based  on  19  test  sessions  with  seven  different  controller  subjects,  it  is 
concluded  that: 

1.  The  Oculometer  produces  an  accurate  record  of  the  visual  performance  of 
a subject  working  in  a simulated  radar  control  situation. 

2.  Because  of  the  increased  ability  to  detect  brief  glances  and  the  increased 
precision  in  determining  the  exact  locus  of  fixation,  the  data  produced  by  the 
Oculometer  system  has  significant  advantages  over  that  obtained  with  the 
conventional  manual  method. 

3.  The  heavy  and  cumbersome  helmet  assembly  and  the  short  4-foot  electronic 
cable  limit  the  field  of  view  and  the  mobility  of  the  subject  and  induce 
distraction  and  discomfort  such  that  the.  manual  method  of  activity  recording 
may  be  preferred  unless  there  is  a specific  need  for  the  more  precise  data 
produced  by  the  Oculometer. 


RECOMMENDATIONS 


1.  The  potential  usefulness  of  the  Oculometer  in  civil  aviation  research  and 
development  studies  warrants  the  coat  that  will  be  incurred,  and  for  that  reason 
it  is  recommended  that  a continued  effort  be  made  to  improve  the  packaging  of 
the  system,  reducing  the  discomfort  of  use,  and  improving  flexibility  of 
application.  One  particular  Improvement  of  value  would  be  a longer  electronic 
cable  from  headset  to  control  panel.  This  would  make  it  more  feasible  to 
perform  experimental  measurements  in  a more  realistic  simulated  sector. 

Another  possibility  that  might  be  examined  would  be  relocation  of  the  TV 
camera  on  top  of  the  helmet.  This  would  reduce  parallax,  making  it  possible 
to  record  closer  fixations  and  might  make  it  feasible  to  add  vertical  and 
horizontal  mechanical  adjustments  to  the  camera  mount. 

2.  An  effort  should  be  made  to  automate  the  categorization  of  glances  ana 
the  measurement  of  duration  of  fixations. 
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APPENDIX 

CONTROLLER  QUESTIONNAIRE 


Oculometer  Project 


Questionnaire 


Subj Date 

Was  the  helmet  comfortable?  

Was  the  restricted  field  of  vision  particularly  bothersome? 


You  wore  the  helmet  for  a total  of  45  minuter  (three  15  minute  data  periods) . 
Could  you  have  worn  It  longer  without  any  difficulty? 

How  long? 

Is  15  minutes  too  long  to  wear  It?  

Please  comment  on  any  aspect  which  this  questionnaire  might  have  neglected. 


Reverse  for  more  space.  Thank  you. 
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